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MANAGEMENT  BEADING  GUIDE 


1.  INTRODUCTION  TO  TRACE  CONCEPT 


Recommended 

Reading 

Pages 


1 - 13 


The  introduction  is  recommended  reading  in  order  to  establish 
the  background,  logic  and  purpose  of  TRACE.  In  addition,  the 
basic  methodologies  and  advantage s / disadvantage s thereof  ire 
fully  discussed.  Comprehension  of  this  section  is  necessaiy. 


2.  OPERATIONAL  MECHANICS  14  - 18 

The  implementation  of  this  section  is  management's  respon- 
sibility. Therefore,  full  comprehension  of  this  section  is 
necessary. 


3.  TRACE  NETWORK  MODELING  19-39 

3. 1 Methodology  for  Network  Modeling  Approach 

This  section  Introduces  some  basic  mathematical  concepts. 

Although  the  narrative  is  technically  Blanted,  management 
should  be  generally  capable  of  comprehending  the  reading 
matter.  This  section  is  optional  reading. 

3.2  Project  X Example  TRACE  Analysis 

This  section  is  directed  to  the  analyst.  Management  should 
scan  this  section  with  particular  attention  to  the  example 
project  network,  page  24,  Pages  25-37  show  example 
computer  output  that  may  be  of  interest.  Managers  employ- 
ing this  methodology  should  read  and  comprehend  this  section. 


4.  TRACE  RISK  TABULATION  40  - 54 

4.1  Introduction 

4.  2 TRACE  Analysis  of  Project  Y 

This  section  is  directed  to  the  manager  and  analyst.  The 
example  is  divided  into  ion  steps.  The  initial  narrative  for 
each  step  is  easily  comprehended  by  management.  The 
matliematical/technlcal  digression  concluding  each  step 
provides  additional  information  for  ti,«  analyst  and  interested 
manager. 
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GLOSSARY  OF  SYMBOLS 


I.  General 

A EL  - Adjusted  Expected  Loss 
DA  - Department  of  the  A rmy 

DAMA-PPR  - Deputy  Chief  of  Staff  for  Research,  Development  and  Acquisition, 
Department  of  the  Army 

DRCDE-P-C  - Directorate  for  Development  and  Engineering,  Army  Development 
and  Readiness  Command 

FY  - Fiscal  Year 

OSD  - Office  Secretary  of  Defense 

PM  - Project  Manager 

PQT-G/C  - Prototype  Qualification  Testing  - Govemment/Contractor 
RC  - Risk  Capital 

TRACE  - Total  Risk  Assessing  Cost  Estimate 


II.  Mathematical 

A EL  - Adjusted  Expected  Loss:  The  probability  point  of  occurrence  corresponding 
to  full  funding.  General:  Any  mathematical  adjustment  to  expected  value  logic 
of  funding  that  is  proportional  to  the  probability  of  occurrence. 

A EL  - Adjusted  Expected  Loss  for  the  tth  element 

C - Composite  of  fixed  (a)  and  variable  cost  (b)  over  specified  time  (t) 


a - fixed  cost  ($) 
b - variable  cost  ($/MN) 
t - time  (MN) 

C».  - TYPE  A Cost  for  the  ith  Element 
Cq(  - TYPE  P Cost  for  the  ith  Element 


E(Cj)  - Expected  value  of  a coat  overrun  for  FY1  given  an  overrun  occurs 

Cj  - Random  coat  variable  for  FY1,  given  the  actual  project  coat 
exceeds  the  FY1  budget 

f(C1)  - Cost  density  function 

d(Cj)  - Differential  cost 

E(lj)  - Expected  loss  for  the  ith  fiscal  year  (product  of  the  expected  cost  E(C|) 
and  the  probability  that  an  overrun  actually  occurs.) 

%E(lj)  - Percentage  of  the  expected  loss  for  the  ith  fiscal  year  to  the  total  expected 
loss  for  all  fiscal  years 

E(ls)  - Total  expected  schedule  loss 

E(ls){  - Total  expected  schedule  loss  through  the  ith  fiscal  year 
f(x)  - Total  project  cost  density  function 

lsj  - Probabilistic  schedule  toss  associated  with  the  Ith  element 

P(A)  - Probability  of  event  A occurring 

P(Aj)  - Probability  of  event  A occurring  for  the  ith  element 

P(A)  - Probability  of  event  A not  occurring 

P(B)  - Probability  of  event  B occurring 

P(Bj)  - Probability  of  event  B occurring  for  the  ith  element 

P(B|A)  - Probability  of  event  B occurring,  given  event  A has  occurred 

P(B|A)  - Probability  of  event  B occurring,  given  event  A did  not  occur 

RC/FY  - Risk  Capital  per  fiscal  year 

RC/FY j - Risk  capital  for  the  ith  fiscal  year 

TYPE  A - Refers  to  a problem  and  cost  of  the  problem  associated  with  a particular 
element/milestone  of  a project 

TYPE  P.  - Refers  to  the  cost  impact  on  other  clements/milcstones  or  to  the  entire 
project  due  to  the  occurrence  of  a TYPE  A problem 


Kj  - Project  tiudget.  for  the  ith  fiscal  year 


terminology 
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TRACE  (Total  Risk  Assessing  Cost 


Estimate)  - Refers  to  the  total  RDTItK  pro)ee. 


cost  which  is  the  sum  of  the  Baseline 


Cost  Estimate  and  the  Risk  Capital. 


BASELINE  COST  ESTIMATE  (BCE)  - The  project  cost,  sometime,  referred  lo  a.  the 

characterized  hy  the  genera)  method  of  dotcrmlatng  pro)cot 


engineering  cost  estimate, 
cost  against  a Used  achedule  for  all  planned  actlvltlee. 


RISK  CAPITAL  (RC)  - Refers  lo  the  total  project  monies 
Ihe  difference  between  TRACE  end  the  BCE. 


retained  at  DA  and  la  mathematically 


RISK  capital/fiscal  yk 


•:AR  (RC/FY)  - The  project  risk  capital  for  a given  flar.al  ye 
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SFCTION  1 


INTRODUCTION  TO  THE  TRACE  CONCEPT 
• 1 Background 

The  TRACE  concept  deals  with  project  RDT&E  budget  planning  under  conditions 
of  rlsk/uncertalnty  and  the  allocation  of  the  monies  to  minimize  cost  growth  resulting  from 
additional  expected  costs.  If  the  costs  are  expected  then  why  not  plan  money  to  cover  the 
costs  using  the  standard  budgeting  approach?  The  costs  are  expected,  but  they  are  probabilistic 
as  to  when  they  will  occur  and  how  much  they  will  be.  Therefore,  it  is  Impossible,  without 
grossly  overbudgeting,  to  plan  fixed  dollars  at  a fixed  time  to  cover  unknown  expenditures  of 
undetermined  amounts.  Though  the  situation  appears  hopeless,  there  are  wayB  to  scientifi- 
cally cope  with  the  problem.  Simply  because  something  is  uncertain  does  not  mean  it  should 
be  ignored.  On  the  contrary,  the  uncertainty  should  be  analyzed  for  the  likelihood  of  problem 
occurrences  and  the  Impact  of  problems.  This  will  define  risks.  Now,  If  we  can  determine 
approximately  when  the  risks  will  occur,  then  we  can  begin  to  logically  manage  the  project 
uncertainties  to  minimize  the  losses.  How  does  private  enterprise  do  it?  They  follow  the 
general  approach  described  below: 

1.  Plan  and  cost  projects  carefully  with  particular  attention  to  schedules. 

2.  Conduct  detailed  analyses  of  all  project  risks  and  when  they  will  likely  occur. 

3.  Budget  against  all  planned  expenditures.  This  usually  includes  a small 
percentage  for  uncertainties.  (K-factor  logic) 

4.  Develop  a strategy  to  cope  with  the  probabilistic  expenditures  beyond  the 
budgeted  amount. 

In  (4.)  above,  there  are  several  strategies  that  may  be  used,  but  the  one  analogous  to  the 
TRACE  concept  is  the  "line  of  credit".  Here  management  knows  that  during  a risky  portion 
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of  the  project  there  is  a fixed  amount  of  money  that  can  be  Immediately  acquired  to  meet 
adverse  expenditures.  A "line  of  credit"  through  the  commercial  banking  system  can  be 
established,  managed,  and  used  to  better  ensure  the  success  of  a project  and  to  minimize 

problematic  costs.  Usually,  such  business  adversities  can  only  be  overcome  by  reserve 
risk  capital  or  a credit  line.  In  either  event  the  money  can  be  obtained  quickly,  when  needed, 
to  avoid  even  greater  losses  due  to  project  incompletion. 

The  system  that  allows  the  commerical  section  to  manage  such  uncertainties  is  the 
commercial  banking  system.  Regardless  of  management  science  tools,  there  must  be  a 
system  that  allows  management  the  flexibility  to  manage.  The  defense  sector  has  never  had 
any  system  that  allowed  a project  manager  an  effective  means  to  cope  with  uncertalntit 
The  TRACE  concept  gives  the  project  manager  the  flexibility,  authority,  and  means  to 
effectively  manage  through  all  types  of  adversities. 

Analogous  to  the  commercial  banking  system  there  is  a system  that  allows  the  TRACE 
concept  to  work.  The  operational  mechanics  of  this  system  are  discussed  in  Section  2. 

The  system  has  certain  rules  and  requirements,  and  has  the  necessary  "checks  and 
balances"  to  ensure  continuing  operation. 

With  the  knowledge  of  the  operational  system,  the  manager  should  be  mainly  concerned 
with  the  TRACE  methodology  used  on  his  project.  These  guidelines  address  various 
methodologies  and  thought  processes  that  are  generally  appropriate  for  TRACE  analyses. 

For  the  TRACE  concept  to  work,  management  must  understand  the  logic  associated  with 
the  methodology  that  is  used  and  there  can  be  no  communication  gap  between  the  manager 
and  analyst.  TRACE  analyses  are  tied  tco  closely  to  the  success  of  the  project  and  the 
mistakes  in  this  work  are  too  costly  for  managers  and  analysts  to  isolate  one  another. 
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For  this  reason,  these  guidelines  have  been  prepared  for  the  manager  and  analyst  in  an 
attempt  to  bridge  any  communication  gap  that  may  exist. 
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1,  2 Methodology  Overview 

The  numerous  methods  for  determining  risk  capital  and  its  allocation  preclude 
the  possibility  of  a totally  comprehensive  discussion.  The  objective  of  this  document 
is  to  guide  the  manager  and  analyst  with  the  intent  of  the  thought  process,  fn  no  way  is 
this  document  meant  to  constrain  creativity  or  thwart  the  development  of  new  and 
improved  methodologies. 

1.2.1  Risk  Capital 

At  the  outset,  it  is  acknowledged  there  is  no  precise  answer  to  how  much  money 
should  be  allocated  to  avoid  excessive  risk  tak:ng.  To  ignore  uncertainties  and  expected 
problems  is  unrealistic,  yet  to  fund  at  a level  to  cover  all  risks  is  equally  unrealistic. 
Therefore,  as  in  any  business,  the  objective  is  to  strike  a reasonable  balance  between 
risks  and  investment  capital  (RDT&E  funds). 

What  is  "reasonable"  and  will  Congress  and  top  defense  managers  accept  such  a 
value?  Regardless  of  acceptance,  one  can  only  ask  for  a reasonable  estimate.  This  is 
due  to  the  inherent  humanistic  aspect  of  risk  taking  preferences  with  reeepect  to  monetary 
investments.  For  example,  individual  (A)  may  invest  in  high  riBk/high  return  stock  wher 
another  (B)  will  invest  the  same  sum  in  low  risk/low  return  stock.  Of  course,  (A) 
thinks  (B)  is  conservative  and  (B)  thinks  (A)  is  extravagant  and  both  think  the  other 
foolish.  IIowe\er,  neither  is  wrong  provided  they  did  not  violate  their  own  preference 
for  risk  taking.  This  is  true  regardless  of  the  outcome!  Clearly,  risk  versus  Invcstmeii 
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is  Individualistic  and  any  particular  decision  by  one  man  or  one  group  is  precisely  wrong 
when  viewed  by  any  other  man  or  group.  This  is  also  true  with  value  decisions  con- 
cemiiig  the  Investment  capital  for  weapon  systems.  Therefore,  the  guidelines  have 
addressed  methodologies  that  will  assist  in  establishing  a "reasonable  balance  between 
risks  and  Investment  capital  (RDT&E  funds)". 

Quantitative  Approaches: 

Two  general  approaches  for  quantifying  cost  uncertainties  are, 

1.  Probabilistic  Network  Modeling 

2.  Risk  Tabulation 

The  general  aspects,  advantages  and  disadvantages  of  each  general  approach  are 
discussed  below: 

Probabilistic  Network  Modeling:  This  is  a form  of  modeling  where  there  is  generally 
an  attempt  to  interrelate  cost  and  schedule.  The  models  are  schedule  oriented  in 
that  cost  is  usually  a function  of  the  schedules  of  the  activities  comprising  the  project. 


Fkure  1.1 
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The  nodes  indicate  thp  logic  describing  the  relationship  between  activities.  For 
example,  in  Figure  1. 1,  activities  2,  3 and  4 can  start  only  after  activity  1 is  completed. 
The  activities  carry  cost  and  schedule  Information,  often  where  cost  is  a linear  function 
of  schedule. 


C = a + bt 


Total  Cost  ($)  - Fixed  Cost  ($)  + Variable  Cost  ($/MN)  x Time  (MN) 

, Fixed  Cost  ($)  - one  time  expenditures  (i.e.  materials,  equipment  purchases, 
sub-contracts,  etc.) 

Variable  Cost  (S/MN)  - recurring  cost  or  the  amount  of  money  spent  on  a monthly 

basis  (or  any  time  unit),  (i.e.  labor,  rentals,  progress 
paid  contracts,  etc.) 

Time  (MN)  - activity’  duration  in  months  (or  other  time  unit  compatible  with  variable 
cost  unit) 

For  any  project  activity,  uncertainty  may  exist  with  the  fixed  cost  (a),  the  variable 
cost  (b)  and  the  time  (t).  If  this  uncertainty  can  be  expressed,  then  a Monte  Carlo  simula- 
tion can  handle  the  calculation  of  each  variable.  An  example  for  Activity  1 is  given  below. 
Note:  The  uniform  and  triangular  distributions  are  examples.  Other  forms  are  also 
used  in  practice. 

Activity  tfl 

Fixed  Cost  (a) 

K$ 


(it)  85 

UNIFORM  DISTRIBUTION 


Input  data  reflect  the  fixed  cost  could  be  as 
low  as  $tiO  K or  as  high  as  $85  K and  it  is 
equally  likely  to  be  any  value  between. 
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Variable  Cost  (b) 
K$/MN 


9 12  15 


TRIANGULAR  DISTRIBUTION 


Input  data  reflect  the  variable  cost  will 
most  likely  be  around  $12  K/MN,  but 
could  be  as  low  as  $9  K/MN  or  as  high 
as  $15  K/MN  with  diminishing  possibilities 
toward  the  extrt  ines. 


Time  (t) 

MN 

Input  data  reflect  the  time  for  Activity  1 
cannot  be  leBs  than  8 MN,  will  most  likely 
be  around  10  MN  and  could  be  as  much  as 
8 10  17  17  MN,  with  dim'nishlng  possibilities 

toward  the  extremes. 

TRIANGULAR  DISTRIBUTION 


The  Monte  Carlo  simulation  technique  will  sample  each  input  distribution 
and  perform  the  calculation,  C = a +•  bt,  many  times  until  a statistical  distribution  can  be 
determined  for  the  cost  of  Activity  1.  For  the  above  example  a Monte  Carlo  simulation 
with  500  samplings  yielded  the  cost  distribution  shown  In  Figure  1.2,  page  8. 

Computer  aided,  the  Monte  Carlo  simulation  technique  can  be  used  to  combine 
probabilistic  cost  of  any  number  of  activities  according  to  the  node  logic  of  the  network. 

For  an  example,  see  Figure  1.  3,  page  9.  The  output  of  the  simulation  la  in  the  form  of 
statistical  distributions  and  is  structured  to  assist  in  the  decisions  concerning  TRACE  and 
risk  capital.  The  output  is  based  on  the  probabilistic  cost  of  all  planned  and  contingency 
activities.  The  total  of  these  costs  for  the  entire  project  is  needed  to  determine  the  TRACE 


and  total  risk  capital  value. 


Monte  Carlo  Simulation 


whichever  is  longer 


p 


In  order  to  allocate  the  TRACE  and  risk  cap'tal  by  fiscal  year,  probabilistic  cost 
Information  by  fiscal  year  is  needed  or  is,  at  least,  helpful.  The  allocation  of  the  risk 
capital  money  is  made  in  a manner  to  reduce  future  expected  losses.  That  is,  more 
risk  capital  is  provided  in  the  years  where  the  uncertainty  and  cost  impact  are  the 
greatest.  This  is  in  contrast  to  the  logic  of  allocating  in  proportion  to  total  dollars  each 
fiscal  year  (e.g.  10^  risk  capital  for  each  fiscal  year). 


Advantages  of  Network  Modeling: 

1.  The  cost  uncertainty  associated  with  the  interaction  of  the  activity 
schedules  and  their  uncertainty  is  accounted  for  in  the  total  cost. 

Note:  Preliminary  studies  indicate  that  50"  - 90%  of  the  total  cost 
uncertainty  is  a direct  result  of  schedule  uncertainty. 

2.  There  is  maximum  flexibility  with  the  form  and  collection  of  the  output 
data  for  decision-making  purposes. 

3.  When  maintained  on  a continuing  basis,  the  network  model  can  be 
operated  many  times,  quickly  and  inexpensively. 

4.  The  network  can  be  used  to  estimate  the  Basic  Engineering  Cost  (BCE) 
using  fixed  schedules. 

5.  The  network  can  be  used  to  track  and  control  as  well  as  predict  a 
project's  cost  and  schedule. 


Disadvantages  of  Network  Modeling: 

1.  A high  analytical  skill  level  is  required  to  build  the  network  and  collect  the 
data.  The  output  of  the  model  is  very  sensitive  to  the  management  logic 
associated  with  the  project  activities.  Seemingly  insignificant  assumptions 
can  totally  negate  the  usefulness  of  the  output  data.  The  modeling  difficulty 


coupled  willi  the  sensitivity  demand  experienced  and  skillful  analysts. 

2.  The  selection  of  an  appropriate  network  model  is  difficult.  Thts  is  due  to  the 
numerous  network  management  models  available  with  a wide  variation  in  the 


quality  of  the  programs  (i.e.  usefulness,  flexibility,  operational  assumptions 
and  Internal  operations). 

Note  to  Management:  The  manager  should  be  concerned  about  the  network  model 
used  on  his  project.  Presently,  there  are  no  formal  screening  or  evaluation 
procedures  for  computer  programs.  Therefore,  the  manager  should  seek  the 
recommendation  of  a qualified  TRACE  analyst.  In  addition,  management 
should  stay  involved  with  the  analysis  due  to  the  often  experienced  difficulty  of 
recognizing  the  quality  of  the  output  data.  Typically,  computer  output  in- 
formation is  impressive  in  appearance  and  quantity.  Management's  blessings 
on  the  output  of  a network  model  should  result  from  careful  study  and  scrutiny 
of  the  analysis. 

3.  Cost  as  a linear  function  of  time  is  not  traditionally  used,  is  not  totally  con- 
sistent with  the  breakdown  structure,  and  is  not  easily  comprehended. 

4.  The  cost  for  network  analyses  on  major  projects  is  initially  high  and  requires 
about  three  months  before  any  output  data  is  generated.  This  :nitial  dis- 
advantage is  offset  by  savings  if  the  project  uses  the  network  model  on  a 
long-term  basis. 


2 Risk  Tabulation 

In  this  approach  for  quantifying  cost  uncertainties,  each  activity  or  hardware 
clement  of  a project  is  addressed.  In  addition,  all  other  potential  problems  are  itemized, 
and  in  particular,  those  related  to  schedule  risk.  A tabular  type  data  entry  is  sufficient 
for  this  analysis.  The  details  of  this  approach  are  discussed  in  Section  4,  page  40,  but 
in  general  the  analysis  is  based  upon  the  calculation  of  the  expected  loss  associated  with 
each  element.  The  total  expected  loss  combined  with  appropriate  decision  logic  deter- 
mines the  total  risk  capital.  The  fiscal  year  allocation  is  based  upon  when  the  cost 
impact  will  likely  occur. 


Advantages  of  Tabulating  Risks: 

1.  The  analysis  does  not  require  a high  analytical  skill  level. 

2.  The  analysis  can  be  performed  quickly  and  inexpensively  in  comparison 
(o  computer  modeling. 
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3,  The  analysis  can  easily  be  comprehended  since  complicated  interrelations 
are  avoided. 

4.  The  quality  of  the  analysis  can  be  easily  ascertained  by  management  due  to  the 
openness  and  simplicity  of  the  analysis.  T..sre  are  no  hidden  assumptions  or 
modeling  errors. 

Disadvantages  of  Tabulating  Risks: 

1.  This  type  of  analysis  does  not  fully  address  the  interrelationships  between 
program  elements,  or  the  expected  savings  from  the  early  completion  of 
program  activities.  These  omissions  adversely  affect  the  quality  of  risk 
capital  determination  and  the  allocation  of  the  monies  by  fiscal  year.  This 
disadvantage  is  more  pronounced  on  the  larger,  more  complicated  weapon 
system  projects. 

2.  The  simplicity  of  the  analysis  often  encourages  misinterpretations.  This  is 
largely  due  to  the  intuitive,  rather  ihan  statistical,  use  of  the  expected  loss 
term.  Tying  the  expected  loss  calculations  directly  to  WBS  elements 
implies  that  the  risk  capital  allocated  for  each  element  will  be  spent  against 
that  element  to  reduce  or  eliminate  the  risk.  This  is  totally  false  in  that  we 
do  not  know  exactly  where  or  how  much  will  be  spent  against  uncertainties. 

We  do  know  it  will  never  be  the  amount  calculated  as  the  expected  loss. 
Therefore,  the  expected  loss  term  is  rather  meaningless  after  its  statistical 
use  in  the  determination  and  allocation  of  risk  capital. 

3.  The  flexibility  of  the  analysis  and  the  output  is  extremely  limited.  That  is, 
any  significant  changes  in  a project's  schedule  or  requirements  would  likely 
dictate  a completely  new  analysis.  At  the  time  these  studies  are  normally 
performed  there  are  many  program  changes  which  could  preclude  this 
approach  from  being  responsive. 

4.  There  is  no  indication  as  lo  the  total  program  risk.  For  example,  in 
the  networking  approach,  the  total  dollars  are  based  upon  a probability 
(50/30,  00/40,  etc.)  of  successful  completion  of  the  total  project. 


1.2.3  Guidelines  on  Selecting  the  Approach 


The  network  modeling  approach  should  be  used  on  all  projects  where  It  Is  not 
prohibitive  due  to  cost,  schedule,  analytical  expertise  or  computer  system  and  program 
availability.  The  exceptions  are: 

1.  When  a project  is  early  in  the  conceptual  phase  and  a management  plan  does  not 
exist  to  the  extent  that  a credible  model  can  be  developed  and/or  data  collected, 

2.  When  a project's  management  plan  Is  of  such  obvious  simplicity  that  tho 
interrelationships  can  be  properly  addressed  through  Iteml7.lng  the  risks, 

3.  When  the  project  manager  does  not  relate  to  the  network  approach  and  desires 
to  use  a different  approach.  (This  is  allowable  since  tho  project  malinger  l*iars 
the  full  responsibility  of  the  project  and  all  studies  contributing  to  the  support 
of  the  project.) 


SECTION  2 


OPERATIONAL  MECHANICS 

2.1  Operational  Flow  (Hoforcnce  Figure  2.1,  page  15) 

The  referenced  flow  chart  plotorially  describes  the  operational  mechanics  of  the 
TRACK  concept.  The  How  describes  the  procosp  for  the  Initial  and  subsequent 
determ (nation s of  the  total  risk  capital  (RC)  and  the  FY  allocations  (RC/FY)  and  the 
process  for  release  of  the  RC/FY  funds.  The  following  discussion  addresses  each 
aspect  of  the  flow  chart. 

The  determination  of  the  initial  values  for  the  total  risk  capital  and  the  fiscal  year 
allocutions  of  the  monies  Is  the  responsibility  of  the  respective  project  offices.  The 
dctei  ruination  may  l*e  made  using  one  of  the  methodologies  described  in  this  document 
or  n different  methodology  at  the  discretion  of  the  project  manager.  In  any  event,  the 
analysis  and  logic  must  Ixi  well  documented  as  appropriate  to  support  a formal  review 
and  approval  process.  The  formal  documentation  should  address  the  following: 

(for  details  reference  Annex  A) 

1,  Results  (Recommended  TRACE  ti  Risk  Capital) 

2.  Methodology 

1$.  Cost  Omissions 

4,  Significant  Assumptions 

G,  pertinent  Discussion  (Addressing  the  analysis, 

allocation  by  fiscal  year,  logic,  significant  points  or  findings) 

(l,  Alternatives  (Address  only  the  viable  alternatives,  If  any,  and  only  to  the 
depth  necessary  to  provide  essential  decision  Information) 
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The  initial  approval  of  the  TRACE  and  the  allocation  by  fiscal  year  will  follow  the 

same  process  through  DA  and  Congressional  levels  as  any  budget  request.  As  a 

result  of  the  approval  process,  a TRACE  determination  will  be  made.  A project's 

total  risk  capital  and  its  FY  allocation  may  be  altered  during  this  process. 

Note  to  Management:  The  first  approval  process  is  probably  the  most  important 
and  an  extra  effort  on  this  analysis  and  the  documentation  is  encouraged.  To  later 
change  the  total  TRACE  dollars  upward  is  a difficult  task.  However,  there  is  a 
built-in  flexibility  for  trade-offs  between  fiscal  years  within  the  total  TRACE 
dollars. 

After  the  TRACE  is  approved,  uninterrupted  project  operation  with  those  funds  can 
begin.  The  project  manager  need  be  concerned  only  with  the  process  of  getting  the 
funds  and  with  the  process  of  changing  the  funding  levels.  These  two  operations, 

"Risk  Capital  Request"  and  "Budget  Adjustment  Request",  are  described  below. 

2. 1 . 1 Risk  Capital  Request 

For  the  project  manager  to  receive  all  or  any  portion  of  the  approved  risk  capital 
allocation  for  the  current  operational  fiscal  year,  a brief  request  must  be  sent  to 
Deputy  Chief  of  Staff  for  Research,  Development  and  Acquisition  (DAMA-PPR)  with 
an  information  copy  to  Directorate  for  Development  and  Engineering  (DRCDE-PC). 
(Reference  Annex  B,  Risk  Capital  Request.)  The  funds  will  be  released  for  project 
use  in  a maximum  of  four  (4)  working  days  from  receipt  of  the  request.  The  project 
is  required  to  send  a follow-up  justification  to  DRCDD-PC  within  thirty  (30)  working 
days  of  the  original  request.  (Reference  Annex  B,  Rfsk  Capital  Justification.) 
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DRCDE-PC  is  the  point  of  contact  and  action  agency  at  DARCOM.  Their 
responsibilities  regarding  FY  risk  capital  requests  are  to: 


1.  Maintain  a record  of  all  requests. 
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2.  Ensure  the  operational  process  is  followed. 

3.  Ensure  the  risk  capital  funds  are  being  generally  used  as  Intended. 


DAMA-PPR  is  the  DA  staff  point  of  contact  and  the  organization  responsible  for  the 
release  of  the  risk  capital  to  the  project  office.  Their  responsibilities  regarding 
risk  capital  requests  are  to: 

1.  .Ensure  the  Risk  Capital  Request  basically  supports  the  release  of  funds. 

2.  Ensure  that  the  funds  are  made  available  to  the  project  office  in  a maximum  of 
four  (4)  working  days. 

3.  Make  recommendations  to  the  DCSRDA  concerning  action  to  be  taken  for 
projects  that  have  violated  the  purpose  and  use  of  the  risk  capital  funds. 

Note  to  Management:  The  DCSRDA  will  not  exercise  authority  to  deny 
allocated  risk  capital  to  project  offices,  provided  the  minimal  requirements 
in  the  request  are  met.  In  other  words,  the  project  manager  will  get  all 
or  any  portion  of  the  approved  fiscal  year  risk  capital  for  the  asking. 

This  gives  the  PM  maximum  flexibility  with  the  money  virtually  at  his 
fingertips.  Only  in  unusual  cases  or  where  a PM  misuses  the  funds  will 
DAMA-PPR  require  advance  formal  justification  and/or  detailed  accounting 
of  the  risk  capital,  and/or  other  measures  as  appropriate. 

2. 1. 2 Budget  Adjustments  Request 

To  increase  the  approved  TRACE  requires  a detailed  redetermlnatlon  of  TRACE  and 
Risk  Capital  with  DA  and  Congressional  approval.  However,  if  there  are  downward 
changes  in  the  TRACE  or  changes  in  the  distribution  of  the  risk  capital  between  fiscal 
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years,  then  the  request  requires  justification  but  the  approval  process  is  totally 
within  DA.  The  project  manager  is  encouraged  to  evaluate  the  project's  risk  capital 
requirement  each  year.  This  seems  prudent  since  the  FY  risk  capital  was  planned 
against  uncertainties,  and  with  one  year  of  the  uncertainties  removed,  additional 
knowledge  is  available  for  a better  allocation  of  the  monies. 


Although  advisable,  the  redetermination  of  the  total  and  FY  risk  capital  need  not 

follow  the  same  methodology  as  the  initial  determination!  however,  appropriate 

analysis  and  logic  to  support  a formal  request  Is  required.  The  request  Is  fowarded 

to  DAMA-PPR  through  DRCDE-PC.  Approval/disapproval  will  require  a maximum  of 

15  work-days  upon  receipt  of  the  request.  With  approval,  the  funds  will  be  established 

according  to  the  request  or  a compromise  thereof  and  any  excess  risk  capital  funds, 

not  carried  forward,  will  be  returned  to  DA. 

Note  to  Management:  In  the  past,  the  idea  of  returning  any  money  to  DA  or 
Congress  on  a weapon  system  project  was  deemed  undesirable  and  an  indication 
of  management's  Inability  to  accurately  estimate  costs  and  budgets.  THIS  IDEA 
IS  CHANGING.  The  mere  recognition  of  rlBk  capital  implies  a recognition  of 
uncertainty.  When  all  or  a portion  of  the  risk  capital  is  not  needed,  then  it 
should  be  returned  to  DA.  Only  when  management  has  grossly  overbudgeted  for 
planned  expenditures  would  the  return  of  funds  warrant  any  unfavorable  response. 
To  manage  through  the  uncertainty  without  the  need  for  the  risk  capital  would 
truly  be  remarkable  and  the  management  should  be  rewarded.  Furthermore, 
with  the  succesBfulness  of  the  TRACE  concept  proven.  Congress  may  allow  DA 
the  discretion  to  reinvest  the  excess  funds  into  other  projects.  Certainly,  this 
is  more  effectl-e  than  the  widespread  expenditure  of  year-end  project  funds 
simply  because  the  funds  are  available. 
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SECTION  3 


TRACE  NETWORK  MODELING 

3. 1 Methodology  for  Network  Modeling  Approach 

There  are  numerous  network  models  available.  The  quality  and  capability 
of  the  models  vary  greatly.  It  is  not  possible  to  discuss  all  of  the  models; 
therefore,  the  discussion  will  address  the  application  of  a particular  model.  The 
model  was  used  for  a TRACE  analysis  on  a project  at  the  U.S.  Army  MlBslle  Command. 

First,  the  methodology  associated  with  the  network  model  is  discussed.  Secondly, 
an  example  TRACE  study  is  presented  for  the  purpose  of  conveying  the  thought  process 
of  the  analysis. 

The  development  of  a network  of  the  project  activities  1b  the  first  step.  The 
network  displays  all  interrelationships  between  project  activities.  The  activities 
consume  resources  (dollars  and  time)  and  are  initiated  and  terminated  according  to  the 
management  logic  expressed  at  the  nodes. 

Note  to  Analyst:  Node  logic  varies  between  network  programs.  In  selecting 

a program  the  analyst  should  study  the  node  logic  carefully.  The  logic  must 

be  sufficiently  sophisticated  to  adequately  model  the  project. 

The  statistical  outputs  used  in  the  TRACE  analysis  are: 

a.  Total  cost  frequency  distribution 

b.  Total  cumulative  cost  frequency  distribution 

c.  Cost  distribution  per  fiscal  year 

TRACE  Determination 

The  TRACE  point  (total  probabilistic  cost  of  the  project)  is  simply  the  point 
on  the  distribution  corresponding  to  a desired  level  of  risk  taking.  The  actual  risk 
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point  determining  the  TRACE  value  is  the  50/50  point  unless  there  is  justification 
for  deviation.  The  50/50  point  on  the  cost  distribution  should  always  be  provided 
in  the  results  of  a TRACE  network  analysis.  This  is  for  comparison  purposes  or 
a baseline  in  viewing  other  Army  projects. 

It  is  not  within  the  scope  of  this  document  to  discuss  all  of  the  subtleties 
Involved  with  the  analysis  of  probabilistic  data.  However,  a brief  description  of 
a plan  of  analysis  is  described  below. 

1.  TRACE  has  been  defined  as  the  50/50  point  on  the  total  cost  distribution  f(x). 
Therefore,  the  first  step  is  to  determine  the  50/50  point  or  median  (B). 


Figure  3. 1 


BASELINE 
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2.  The  baseline  engineering  cost  (A)  must  be  established.  This  is  the 
estimated  cost  of  all  of  the  planned  activities  and  expenditures.  This  cost  may 
be  determined  with  the  network  model  by  eliminating  probabilistic  and  contingency 
activities  and  using  only  deterministic  inputs  for  cost  and  schedule.  Or,  the  cost 
may  be  determined  by  other  valid  means  such  as  the  Work  Breakdown  Structure 
approach. 


3.  The  risk  capital  is  determined  by  subtracting  (A)  from  (B)  and  is  represented 
by  the  shaded  area  in  Figure  3.2. 

The  purpose  of  risk  capital  Is  to  cover  a percentage  of  the  expected  cost  overran, 
provided  the  overrun  actually  occurs. 

Consider  the  example  cost  distribution  in  Figure  3.3  for  the  fiscal  year  FY1; 


Figure  3.3 


Given  a cost  overrun  (cost  greater  than  the  engineering  cost  estimate  (xj),  then 
the  true  cost  will  fall  somewhere  to  the  right  of  (Xj)  in  the  shaded  area.  The 
probability  of  this  occurrence  is  1.0,  therefore  the  shaded  area  under  the  curve 
must  equal  1.0.  This  is  done  mathematically  where  the  shaded  area  is  normalized 
to  an  area  of  1.0  and  a new  probability  density  function  f(cj)  is  established.  The 
expected  value  is  then  calculated  by  conventional  methods. 

For  the  new  random  variable  the  expected  value  is. 


E(cj)  = 


£ 


+oo 

f(Cj)  dcj_ 


Likewise  the  expected  values  E(C2>t  and  E(Cg)  for  FY2  and  FY3  can  be  calculated. 

E(cj)  is  the  expected  value  of  the  cost  overrun  for  the  ith  fiscal  year,  given 
there  Is  an  overrun.  The  expected  loss  for  the  Ith  fiscal  year  is  the  expected 
value  of  the  overrun  multiplied  by  the  probability  an  overrun  will  actually  occur. 

E(lj)  = E(cj)  x P (actual  cost  is  greater  than  Xj) 

The  percentage  of  the  total  of  the  expected  loss  for  any  year  is  determined  as  shown  in 
the  example  calculation  for  FY1  given  below: 


% E(lj>  = 


Efll) 

E(lj)  + E(l2)  + E(l3) 


And  finally,  the  percentage  of  risk  capital  per  fiscal  year, 
RC/FY1  = % E(lj)  x RC 
RC/FY2  = % E(l2)  x RC 
RC/FY3  = % E(l3)  x RC 


The  example  analysis  is  adequate  for  all  known  activities  and  contingency 
activities.  However,  the  model  and  the  analysis  have  neglected  all  of  the  costs  of 
activities  we  know  nothing  about.  There  is  no  approach  other  than  looking  at  the 
histories  of  similar  projects  and  allocating  a percentage  of  funds  that  will  offset 
"cost  surprises"  which  are  sure  to  occur.  Other  known  cost  omissions  should  be 
addressed  and  handled  on  an  exception  basis. 


Project  X Example  TRACE  Analysis 


The  following  example  is  taken  from  an  actual  TRACE  analysis  performed  on 
a system  at  the  Army  Missile  Command.  This  example  includes  the  network  model, 
data  inputs,  TRACE  and  risk  capital  outputs,  and  the  documentation  for  die  budget 
request.  The  example  is  not  regulatory,  but  rather  provided  as  a guide  to 
demonstrate  an  acceptable  thought  process  for  a TRACE  analysis. 

Reference  the  following  information: 

1.  Project  X TRACE  Network  (Figure  3.4  page  27). 

The  network  represents  all  RDT&E  project  activities  and  their  interrelationships. 
The  detail  of  the  network  is  a matter  of  judgement.  However,  the  main 
considerations  are: 

a.  The  model  should  sufficiently  demonstrate  the  management  philosophy  and 
interrelationship  between  activities. 

b.  The  costs  must  be  properly  accumulated  for  the  total  project  and  for  each 
fiscal  year. 

2.  Project  X Cost  and  Schedule  Input  Data,  Annex  C. 

3.  Data  Output  and  Analysis. 

The  output  for  schedule  and  joint  cost/schedule  risk  has  been  omitted  for 
brevity.  The  essential  output  data  for  a TRACE  analysis  are  as  follows: 

Page 

a.  Cost  distribution  for  all  activities  29 

b.  Cumulative  cost  distribution  for  all  activities  30 

c.  Cost  distributions  and  cumulative  cost  distributions 
for  each  fiscal  year 


31-38 


Page 


d.  Expected  loss  and  risk  allocation  by  fiscal  year 
at  selected  TRACE  percentile 

(i.e.  50  percent,  60  percent,  etc.)  39 

TRACE  at  the  50/50  risk  point  is  read  directly  from  the  cumulative  cost  distribution 
as  $167. 65M.  Other  risk  points  may  also  be  determined  from  this  distribution. 


The  risk  capital  allocations  (page  39)  are  performed  by  the  computer  In 
accordance  to  the  methodology  discussed  In  Section  3. 1,  pages  19-23. 

If  this  type  of  output  or  computer  capability  Is  not  available,  then  the  analyst 
will  have  to  use  an  alternate  technique  to  allocate  the  total  risk  capital  funds  by  fiscal 
year. 


Note  to  Analyst:  As  a suggestion  In  this  area,  the  analyst  may  combine  the  network 
and  risk  tabulation  approaches  to  assist  In  FY  allocations.  The  network 
can  be  used  to  determine  the  total  risk  capital  and  tabulation  of  the  significant 
project  risks  to  determine  the  allocation.  In  addition,  seme  networking 
programs  provide  data  at  milestones  which  would  prove  useful  If  the  output 
were  obtained  at  milestones  falling  close  to  fiscal  year  ends. 


Figure  3. <i 
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SECTION  4 


TRACE  RISK  TABULATION 
4. 1 Introduction 

When  an  Interactive  network  model  Is  not  desirable,  another  approach  Is  to 
Individually  address  each  area  of  risk  taking.  This  is  largely  Intuitive;  however, 
the  use  of  some  rather  basic  mathematical  relationships  will  add  greatly  to  the  logic 
and  quality  of  the  analysis. 

This  discussion  addresses  the  type  of  data  that  can  be  obtained  and  what  can  be 
done  with  the  data  to  assist  in  establishing  and  allocating  risk  capital.  A step-by-step 
methodology  is  discussed  below  in  conjunction  with  an  example  vehicle  weapon  system. 


4. 2 TRACE  Analysis  of  Project  (Y) 

1.  Identify  project  elements  for  evaluation  (Reference  Column  1,  Table  4.2, 
page  53). 

This  first  step  simply  segregates  the  project  into  elements  that  can  be  better 
analyzed.  The  most  important  aspect  in  selecting  project  elements  is  to  avoid 
dependencies  and  double  counting.  A project  may  be  described  by  WBS  elements, 
program  milestones,  functional  activities  or  a combination  thereof.  Functional 
activities  are  best  used  with  a network  approach;  therefore  the  example  vehicle 
system  is  described  by  WBS  elements  and  major  program  milestones.  The  approach 
will  be  to  evaluate  the  risk  and  impact  for  each  element/milestone  and  the  impact  of 
each  element/milestone  on  the  total  project  (relationship  to  all  other  elements  and 
milestones).  Only  the  project  elements/milestones  with  a meaningful  probability  of 
cost  overrun  need  be  addressed. 
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2.  Assess  the  probability  of  occurrence  (P(A))  of  a cost  Impact  to  each  element  or 
milestone  and  the  amount  of  the  cost  Impact.  The  probability  value  Is  subjective  and, 
at  best,  represents  a reasonable  management  estimate  of  the  likelihood  of  the  event 
occurring  (Column  2).  Table  4.1,  page  42  can  be  used  as  a guide  for  establishing 
probability  values. 

The  cost  impact  (Column  3)  of  a particular  element/ milestone  is  defined  as  TYPE  A 
cost.  The  amount  of  cost  impact  deals  only  with  the  cost  to  that  particular  element. 
For  example,  if  the  power  train  has  a problem  then  it  will  take  an  estimated  $1.5M 
to  correct  the  power  train  only. 


3.  Given  a TYPE  A problem  has  occurred,  assess  the  probability  of  a cost  impact 
to  other  program  elements  or  the  entire  program.  This  type  of  cost  impact  is  defined 
as  TYPE  B.  The  probability,  mathematically  speaking,  is  the  probability  of  B given 
A or  P(B  A).  This  term  is  necessary  in  order  to  calculate  P(B),  the  unconditional 
probability  of  B occurring  (Column  5).  Both  P(A)  and  P(B)  are  needed  to  calculate 
expected  loss,  which  is  explained  later  in  paragraph  6,  page  45. 

The  relationship  of  TYPE  A and  TYPE  B costs  can  vary  and  is  worth  a mathematical 
digression  for  further  explanation. 


Definitions: 

Event  A:  TYPE  A cost  impact  is  Incurred 
Event  B:  TYPE  B cost  impact  is  Incurred 


Assumption:  Event  B cannot  occur  unless  Event  A has  occurred  (where  TYPE  A 
cost  impact  may  be  equal  to  zero.) 

Therefore, 

P(B)  ■=  P(B(  A)P(A)  + P(B  | A)P(S) 
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Qualitative  Quantitative 

1.  It  is  as  likely  as  not  the  event  will  occur.  . 50  Probability  or  60/50  chance 

In  other  words  you  cannot  distinguish 

which  event  is  more  likely. 

2.  It  is  more  likely  for  the  event  to  occur  than 


not.  Management  feels  about  this, 
a.  Virtually  Certain 

. DO  to  1 . 0 

b.  Strongly 

.76 

c.  Moderately 

.00 

d,  Only  slightly 

,55 

It  Is  more  likely  for  the  event  not  to  occur 
than  to  occur,  Management  feels  about 
this, 

a.  Virtually  Certain 

0,0  to  .10 

b.  Strongly 

.26 

e.  Moderately 

.40 

d.  Only  slightly 


.45 


Case  1:  Case  1 will  be  experienced  where  Event  B occurs  with  certainty,  given 
Event  A has  occurred. 

P(B)=P(B|  A)P(A) 

P(B)-(1. 0)P(A) 

P(B)=P(A) 

Example:  For  the  suspension  system  there  Is  a 60%  chance  of  a TYPE  A problem. 

Given  the  problem  occurs,  there  Is  a 100%  chance  of  a TYPE  B problem. 

P(A)  = . 60  P(B|A)  = 1.0 

Therefore,  P(B)  = (.  60)(1.0)  = . 60 

Case  2:  Event  B will  probabilistically  occur,  given  Event  A has  occurred. 
P(I^=P(B|A)P(A) 

Example:  For  the  power  train  there  is  a 50%  chance  of  problems  (TYPE  A). 

Given  there  Is  a problem,  there  is  a 60%  chance  It  will  cause  a program 
Impact  (TYPE  B),  Here, 

P(A)=.  50  P(B|  A)  = . 60 

Therefore,  P(B)=(.  50) (.  60)  = .30 


t.  Determine  Ihe  TYPE  B cost/schedule  impact  to  the  project  (Column  6).  The 
TYPE  B cost  is  an  estimate  of  the  total  cost  to  the  project,  excluding  the  TYPE  A 
cost  to  the  particular  element.  The  schedule  slippage  or  impact  should  be  noted 
as  to  which  elements  are  affected  or  if  the  total  project  is  affected.  Total  program 
schedule  slips  are  indicated  by  asterisks  in  Column  6.  The  engine,  element  5, 
causes  a . lmn  schedule  impact  to  the  qualification  program  and  is  so  noted. 

Example  of  TYPE  B cost:  Tf  a problem  is  incurred  with  the  power  train,  the  co3t 
(TYPE  A)  to  fix  the  power  train  is  $1.5M  and  the  cost  (TYPE  B)  to  the 
entire  project  is  $4M  and  2 months  slip  in  the  total  schedule.  The  $4M  is  a 
result  of  the  power  train's  Interaction  with  other  program  elements  in  that 
system  integration  cannot  begin  until  an  acceptable  power  train  has  been 
delivered.  The  government  must  pay  for  contractor  and  government 
personnel  during  this  period  of  non-productlvlty.  Therefore,  the  indirect 
cost  of  the  problem  is  greater  than  the  direct  cost  of  the  problem. 


5.  Predict  the  calendar  time  {month  and  year)  and  corresponding  fiscal  year  the 
problem  will  occur.  The  elements  must  be  listed  In  aBcend'ng  order  according  to  the 
calendar  date  of  problem  occurrence.  This  information  will  assist  in  the  allocation  of 
the  risk  capital  (Columns  7 and  8). 

6.  Calculate  the  expected  loss  for  each  element/milestone  (Column  9). 

Expected  Loss  = (Probability  of  a cost  impact)  x (Amount  of  the  cost  Impact) 
Since  there  are  two  types  of  cost  or  losses  defined  as  TYPE  A and  TYPE  B,  the 
expected  loss  for  any  element  is, 

Ea1)  = P(A1)xCAl+P(Bl)xCBi 
Where,  CAl  = Cost  of  TYPE  A for  the  ith  element 
Cgj  = Cost  of  TYPE  B for  the  ith  element 
E(lj)  = Expected  loss  (cost)  for  the  ith  element 
P(Aj)  = Probability  TYPE  A Impact  occurs  for  the  ith  element 
P(Bj)  = Probability  TYPE  B impact  occurs  for  the  ith  element 

Example  Calculation  for  Power  Train; 

P(A5)  --  . 60  P(Sg)  * . 45 

CAs  = $1.5M  Cb5=S4M 

E(lg)  = (.  60)(1.  5)  + (,  4 5) (4)  =$2.70M 

7.  Calculate  the  Adjusted  Expected  Loss  (AEL)  (Column  10).  The  AEL  term  is 
necessary  to  meaningfully  determine  the  risk  capital  of  a project.  This  is  due 

to  the  nature  of  the  expected  value  (loss)  statistic.  To  make  credible  decisions  using 

>Vj 


s 


expected  values  means  the  actual  values  will  approach  the  expected  value  on  the  long 

/ 

term.  Expected  value  is  a statistical  term  and  has  nothing  to  do  with  what  we  can 
really  "expect"  to  happen  in  most  cases.  For  example,  consider  the  Initial  Acceptance 
Test  milestones.  There  is  a 70%  chance  of  a $6M  impact  to  the  program.  The  expected 
value  (loss)  is, 

E(l7)  = (.  70)($6M)  = $4.  2M 

If  $4.2  M is  planned,  only  two  things  can  happen, 

1,  There  is  a $6M  impact  and  there  is  not  enough  money 

2.  There  is  not  an  impact,  therefore,  there  is  too  much  money 

If  there  are  a great  number  of  probabilistic  occurrences  of  a similar  magnitude 
in  the  same  time  frame,  expected  value  theory  would  be  more  appropriate.  Since  this 
is  not  the  case  with  most  projects,  then  some  decision  logic  must  be  applied  to  adjust 
the  mathematical  expressions  to  more  realistically  cope  with  the  problem  of  fiscal 
planning.  The  methodology  to  follow  does  not  completely  eliminate  the  problams 
discussed  in  1.  aid  2.  above,  However,  it  does  provide  a more  stable  and 
generally  less  risky  scheme  for  budgeting  purposes. 

ASSUMPTION;  If  a manager  knows  a problem  and  cost  impact  is  virtually  certain 
( probability  . 90  to  1.0),  he  would  budget  the  full  amount.  It  is 
reasonable  to  assume  this  logic  would  hold  true,  at  least,  to  the  point 
where  the  manager  still  feels  strongly  (.  75  probability).  In  other  words, 
If  some  problem  Is  very  likely  to  occur,  management  must  plan  to  have 
all  the  funds  available  - a percentage  of  the  funds  would  not  help  except 
in  certain  c-nscs  where  it  Is  effective  to  buy  time. 
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The  Adjusted  Expected  Loss  (A EL)  is  calculated  using  a linear  adjustment  to 
the  statistical  expected  loss  term.  The  adjustment  is  based  upon  the  logic  that 
all  potential  cost  overruns  with  a probability  of  occurrence  of  . 75  or  greater 
will  be  fully  budgeted.  Lesser  probabilities  will  be  proportionally  adjusted  using 
. 75  as  a basis. 

Example  Calculation  for  Power  Train: 

P(A5)  = .60  P(Bj.)  - .45 
CAs  = $1.5M  CBs=$4M 
E(l5)  = (.60) (1.5)  + (.45) (4)  = $2.  7M 

A EL  » (.  60/.  75)  (1 . 5)  + (.  45/.  75)  (4) 

AEL  ® (1/.  75) f (.  60) (1.  5)  + (.45)(4)] 

AEL  = $3,  6M 

To  obtain  the  AEL  from  the  expected  loss  term,  one  need  only  divide  the  expected  loss 
by  the  AEL  constant  (probability  point  of  full  funding).  This  simple  adjustment 
to  the  expected  loss  term  yields  a term  that  relates  money  to  the  probability  of  need 
and  to  a reasonable  decision  criterion. 

Figure  4,1 , page  48,  graphically  describes  the  decision  criterion  for  the  level 
of  funding  vs.  the  probability  of  problem  occurrence. 

Curve  #1  represents  expected  value  logic  where  funding  is  directly  proportional  to 
the  probability  of  a problem  occurrence,  Y - 100X. 

Curve  #2,  used  In  our  example,  shows  full  funding  above  . 75  probability  and 
proportionally  less  below  . 75  probability.  For  0;X£.  76,  Y s (100/.  75)  X and 
for  ,75  i X < 1.0,  Y = 100, 
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Curve  #3  shows  an  arbitrary  but  logical  decision  criterion  where  there  is  no 
funding  below  . 25  probability,  proportional  funding  between  . 25  and  . 75,  and  full 
finding  above  . 75  probability.  For  0 2X<.25,  Y=0,  for  . 25>X  <.  75, 

Y = -50  + 200X;  for  .75>X<100,  Y = 100. 

8.  Determine  the  total  risk  capital  by  adding  the  AEL's  for  all  elements  and 
milestones. 

For  Project  (Y), 

Risk  Capital  (RC)  = 2 AELi 
l = 1 

RC  = $17.  46M 

9.  Allocate  the  risk  capital  by  fiscal  year.  The  objective  here  is  to  plan  the  RC 
in  the  fiscal  year  it  will  most  likely  be  needed.  However,  since  the  RC  can  be 
transferred  for  1 year,  If  there  is  reasonable  doubt  on  the  allocation,  the  money 
should  be  placed  in  the  earlier  of  the  two  years  under  consideration.  Columns  7 & 8 
contain  estimates  of  when  the  program  impacts  will  occur.  The  estimates  were 
based  on  a fixed  schedule  and  we  are  now  interested  in  when  the  impacts  will 
probabilistically  occur.  V/lthout  the  aid  of  a computer  and  network  model  of  Interactions, 
the  determination  of  a comprehensive  probabilistic  schedule  Is  not  possible.  However, 
one  can  look  to  the  end  of  each  fiscal  year  and  determine  If  the  expenditures  may  fall 

in  the  following  year. 

The  expected  schedule  slippage  for  each  element  can  be  calculated  by  multiplying 
the  probability  of  occurrence  P(b),  by  the  schedule  Impact  (asterisk  designated, 


Column  (I). 


The  total  expected  schedule  slippage  for  the  program  is, 

N 

Efls)  = 2 PtnOOsi) 
t = 1 

E(la)  = Expected  schedule  loss  for  the  program 

P(Bj)  = Probability  of  a problem  occurrence  in  the  1th  element 

lal  = Schedule  loss  associated  with  the  ith  element 

For  the  example  Project  (Y), 

E(ls)  =•  (.  GO)  (2)  + (.  45)  (2)  + (.  75)  (2)  + (.70)(3)  + (.GO)U)  + (.  30)  (2) 
E(1J  = 6-  9 months 

Note:  Element  #5  for  the  engine  is  omitted  since  the  schedule 

slippage  for  the  engine  does  not  Impact  the  overall  program 
schedule. 

This  means  on  the  average  Project  Y will  take  6, 9 months  longer  than  planned. 

Since  the  elements  are  arranged  In  ascending  order  according  to  the  calendar  date  ol 
occurrence,  the  HC  for  the  9th  element  will  be  needed  after  the  8th  element. 

The  expected  schedule  loss  through  the  8th  element  Is, 

E(l„)8  = (•  00>{2)  + (,  4 5)  (2)  + (.  75)  (2)  + (.70X3)  + (,G0)(1) 

E(lg)8  * 0. 3 months 

Therefore,  on  the  average,  the  Impac  t from  element  9 will  not  occur  until  0.3 
months  Inter  than  Us  date  ol  impact  In  Column  <!.  Instead  of  J0/70,  the  Impact  will 
be  4/eQ  calendar  date  The  fb  si  year  remains  FYHO,  The  probabilistic  date  of 
Impact  In  obtained  by  nddbig  the  expected  nl  ppnge  to  the  original  date  of  Impact, 


All  fractional  months  are  rounded  down  to  minimize  the  impact  of  errors  In  the 
analysis.  See  Risk  Capital  Allocation,  Table  4.3,  page  54. 

ADDITIONAL  SAMPLE  CALCULATIONS  FOR  PROBABILISTIC  DATE  OF  IMPACT 
Expected  schedule  loss  through  the  7th  element: 

E(1s)7  = (.  60)  (2)  + (.45)  (2)  + (.  75)  (2)  + (.70)<3) 

E(1s)7^5.7  months 

Probabilistic  date  of  impact  for  element  8 = Calendar  date  of  impact  for  element  8 
+ expected  schedule  loss  through  the  7th  element 

= 7/79  + 5. 8 months 
= 12.8/79  or  12/79 


E(1s)6  = (.  60)  (2)  + (.45)  (2)  + (.75)  (2) 

E(lg)g  = 3.6  months 

Probabilistic  date  of  Impact  of  element  7 = 2/79  + 3.6  months  = 5. 6/79  or  5/79 

10.  The  next  st»p  is  to  review  the  analysis  and  determine  where  good  judgement 
should  alter  the  mathematically  indifferent  results.  Assuming  there  is  a managerial 
exception  for  a transier  of  $1M  from  FY79  to  FY78,  the  solution  to  the  risk  capital 
determination  and  FY  allocation  is  given  below. 


Total  Risk  Capital  $17.46M 
FY  Allocation 


FY 

78 

79 

80 

Risk  Tabulation 

$2. 19M 

$11 . 67M 

$3.  6M 

Project  Y Recommendation 

$3. 19IVT 

$10. 67 M 

$3.  6M 

51 
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Note  to  Management:  Management  Is  encouraged  to  make  exceptions 
in  the  mathematical  process  where  judgement  dictates.  This  is  usually 
necessary  to  "fine  tune"  study  results  to  realistic  management  needs. 
However,  the  exceptions  should  be  clearly  noted. 


PROJECT  Y 

WEAPON  SYSTEM  RISK  ASSESSMENT 
TABLE  4.2 


3 


Total  Program  Schedule  Slips  Totals  $13.09M  $17.46M 


RISK  CAPITAL  ALLOCATION 

TABLE  4,3 

(program  Date  of  Impact  Expected  Slippage  Probabilistic  Date  FY  A EL  RISK 

Elements  Calendar  Date  Prior  to  Given  of  Impact  CAPITAL 

1 2 Element  (Months)  3 Calendar  Date  4 5 4 
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Total  S17.46M 
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ANNKX  A 


TIIACti  ftudget  MikjumI 


TRACE  Budget  Request 


Introduction:  This  Is  an  example  of  the  documentation  to  support  an  Initial  TRACE 
budget  request.  The  following  Information  should  be  provided: 

1.  Results 

a.  50/50  TRACE  point  (applicable  to  network  models  only) 

b.  Recommended  TRACE,  risk  capital  and  fiscal  year  allocations 

2.  Methodology  - brief  discussion  of  methodology  with  appropriate 

attachments  (e.g.  display  of  network,  risk  tables,  etc.) 

3.  Cost  omissions  (Qualitative  discussion) 

a.  Unknowns  - those  things  that  could  not  be  costed  since  they  were  not 

known  to  exist  should  be  addressed.  For  example,  a project  that 
is  significantly  advancing  "the  state  of  the  art"  and  Is  early  in  the 
development  cycle  may  expect  relatively  more  unknowns  to  be  a 
factor 

b.  Knowns  - cost  factors  that  were  knowingly  omitted  from  the  analysis 

4.  Significant  Assumptions  Concerning  (Brief  listing) 

a.  The  project 

b.  The  cost  study 

c.  Other 

5.  Pertinent  Discussion  - addressing  the  analysis,  allocation  of  monies, 

logic  and  significant  points  or  findings 

6.  Alternatives -addressing  only  the  viable  alternatives,  if  any,  and  only  to 

the  extent  necessary  to  provide  essential  decision  Information 

Note  to  Management:  If  viable  alternatives  do  not  exist  or  are  not  under 
consideration,  the  alternative  section  should  be  omitted  with  a note  to 
this  effect.  Under  no  circumstances  should  alternatives  be  generated  for 
the  sake  of  having  alternatives. 
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date x/x/xx 


(EXAMPLE) 

Project  X TRACE  Budget  Request 
1.  Results:  TRACE  and  RINK  CAPITAL 
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2.  Methodology 

The  computations  pertaining  to  the  risk  capital,  TRACE,  schedule  and  allocation 
of  risk  capital  were  performed  using  the  network  analyzer  computer  program.  . 
Figure  1 represents  a portion  of  the  network  related  only  to  the  missile  development. 
The  complete  network  is  comprised  of  all  known  activities  (Government  and  Contractor) 
in  the  Project  X development  program.  These  activities  are  structured  together  to 
capture  the  integration  of  the  subsystems  and  the  interdependencies  of  the  Individual 
activities.  In  addition,  all  major  milestones  and  decision  points  are  included.  The 
major  drivers  of  the  milestones  can  be  identified  in  terms  of  schedule  and  cost  impact. 
The  model  logic  aau  its  supportive  cost  and  schedule  information  were  Inputs  resulting 
in  probabilistic  outputs  for  program  cost  and  schedule  and  cost.  The  applted  network 
methodology  is  consistent  with  the  network  methodology  discussed  In  the  Army 
publication,"  Guide  to  Total  Risk  Assessing  Cost  Estimate  (TRACE)  and  Risk  Capital 
Allocation",  dated  31  December  1976. 

3.  Cost  Omissions 

a.  With  respect  to  unknown  occurrences,  Project  X has  significant  political 
implications.  Relative  to  other  defense  projects  there  is  a higher  probability 
for  the  project  to  receive  program  instructions  from  higher  authorities  that  will 
result  in  a cost  impact.  In  addition,  the  program  schedule  is  dependent  upon 
timely  hardware  deliveries  from  European  sources.  The  project  has  little  control 
over  the  European  vendors  and  anticipates  schedule  and  cost  problems  as  a result. 

t 

The  project's  history  supports  this  statement. 


A -3 


FIGURE  1 - MISSILE  SUBSYSTEM  NETWORK 


b.  The  project  costs  as  modeled  could  have  been  collected  in  constant  dollars 
and  automatically  inflated.  However,  due  to  the  time  constraint,  the  data  were 
collected  in  the  more  accessible  form  of  escalated  dollars.  The  expected  schedule 
for  the  probabilistic  model  is  longer  than  the  schedule  associated  with  the  data  base. 
Thus,  the  TRACE  and  risk  capital  output  is  less  than  if  the  monies  were  appropriately 
escalated. 

4.  Significant  Assumptions 

There  are  no  highly  sensitive  or  peculiar  assumptions  with  the  mathematics  of 
the  network  modeling  and  data  analysis.  The  most  sensitive  assumption  concerns 
the  management  logic  dictating  the  activities  that  must  be  completed  prior  to  the  OSD 
decision  for  production  release.  The  OSD  review  occurs  during  a period  of  high 
monthly  expenditures  and  the  unanticipated  delay  of  this  milestone  would  result  in 
a $2M/month  Impact  to  the  program. 

5.  Discussion 

Due  to  the  stated  cost  omissions,  Project  X recommends  using  the  TRACE  value 
corresponding  to  the  60th  percentile.  The  effects  of  the  cost  omissions  make  the  TRACE 
risks  at  the  60th  percentile  effectively  more.  How  much  more  is  unknown.  There  is 
strong  argument  for  using  the  70th  percentile  and  recomputing  the  risk  capital  at 
the  end  of  the  first  fiscal  year.  However,  the  Project  Office  believes  the  60th  percentile 
to  be  a reasonable  compromise  between  the  more  conservative  70th  percentile  and  the 
50th  percentile  recommended  by  the  DA  guidelines. 

Tn  addition  to  using  the  60th  percentile,  an  additional  $2M  in  FY81  is  recommended 
to  offset  the  risk  associated  with  the  contractor’s  deferring  certain  work  tasks  in 

l'V-f).  This  situation  was  discovered  after  the  completion  of  the  network  analysis  and  the 
<!!•;'  null  required  lids  matter  to  in;  handled  on  an  exception  basis. 
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6.  Alternatives 


There  are  no  major  program  alternatives.  However,  there  is  a management 
option  in  the  testing  program  that  may  generate  significant  cost  savings.  The  option 
Is  to  build  a second  test  site  for  parallel  testing  during  PQT-G/C.  This  will  eliminate 
the  problem  of  range  availability  due  to  sequential  testing  of  the  Joint  Test  and 
PQT-G/C.  The  Joint  Test  may  slip  6 months  or  more  due  to  delayed  European 
hardware  deliveries.  The  cost  to  build  the  second  test  site  is  $.  8M  and  expected 
savings  are  $10M.  The  minimum  savings  are  estimated  at  $4M.  This  Information 
was  recently  generated  through  the  project's  network  model  and  is  presently  being 
verified.  The  decision  will  be  made  within  30  days  to  allow  the  necessary  lead  time. 
With  a favorable  decision  FY81  risk  capital  funds  will  be  used  for  the  project. 
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ANNEX  B 


Fiscal  Year  Risk  Capital  Request  and  Justification 


1 


MESSAGE 


Date  x/x/xx 


TO:  DAMA-PPR 

FROM:  PROJECT  X 

SUBJECT:  RISK  CAPITAL  REQUEST 


1.  Request  risk  capital  in  amount  of  $2,200,000.00  be  released  to  Project  X 
(account # ) on  (date) 

2.  These  monies  will  be  used  for  the  establishment  of  a second  test  site  in  order 
to  reduce  the  calendar  time  for  the  testing  program. 


cf:  DRCDE-PC 


Note  to  Management:  A request  for  risk  capital  must  provide  the  amount 

needed,  the  date  needed  and  the  basic  use  planned  for  the  money.  The 
responsibility  for  the  expenditure  of  these  monies  is  the  project  manager's, 
therefore  an  elaborate  justification  is  not  needed. 


TO: 


DRCDE-PC 


FROM:  PROJECT  X 

SUBJECT:  RISK  CAPITAL  JUSTIFICATION 

1.  Reference  message  dated , subject  Risk  Capital  Request  from 

Project  X to  DAMA-PPR. 

2.  The  justification  of  the  referenced  request  is  given  below. 

3.  The  Project  network  analysis  of  the  cost/schedule  revealed  that  the  European 
delivery  of  the  fire  unit  for  the  joint  test  is  the  most  sensitive  schedule  element. 
This  is  due  to  the  current  test  range  availability  which  dictates  sequential 
joint  testing  followed  by  govemment/contractor  tests. 

4.  A study  was  made  to  determine  which  portions  of  the  testing  program  could  be 
performed  in  parallel  rather  than  in  sequence  and  at  the  same  time  maintain  the 
objectives  of  design  validation  and  data  accumulation  for  a production  decision. 
From  this  study  a test  schedule,  with  parallel  testing  as  appropriate,  was 
developed  and  included  in  a network  analysis  of  the  entire  program.  The  direct 
test  costs  will  not  be  changed  by  testing  in  parallel;  however,  the  indirect  costs 
should  be  reduced  because  of  the  shorter  time  duration. 

5.  Results  of  the  analysis  showed  an  expected  savings  of  at  least  $4M  in  total  program 
costs  and  3 months  in  the  schedule.  The  most  likely  savings  were  found  to  be 
$7M  and  5 months.  These  results  were  obtained  by  using  the  TRACE  network 
model  for  Project  X which  has  been  updated  to  reflect  the  current  program. 
Comparisons  were  made  of  the  output  data  for  the  current  program  with  sequential 
testing  and  the  current  program  with  parallel  testing. 
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6.  In  order  to  gain  these  costs  and  schedule  benefits  It  is  necessary  to  buUd 
a second  test  site.  Funds  in  the  amount  of  $2. 2M  were  released  from  the 
FY77  Risk  Capital  to  the  Project  Office  for  that  objective. 

7.  Backup  data  for  this  justification  and  the  study  of  Project  X Test  Program  are 
available  on  request  for  your  office. 

Note  to  Management:  The  risk  capital  justification  should  be  concise  and  only 
to  the  depth  necessary  to  explain  how  the  funds  are  being  spent 
and  why. 
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ANNEX C 


Cost/Schedule  Input  Data  for  Project  X 
Network  Analysis 
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Electro  Optical  Eng  Manuf  a=0 

St  Test  b=150 


108  ILS  (HAC)  Includes  LSAR  a=0  t=17-19-21 

Mag  Tape  $466K  b=194.  2-2JO.  2 

Training  Opt  @ $850K 


Activity  Description  Y Cost  (SK)  Schedule  Node  From 

Relationships  a-flxed 

b- variable 
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